Leveraging Smartphone Sensor Data for Human Activity Recognition

Using smartphones for human activity recognition (HAR) has a wide range of applications including healthcare, daily fitness recording, and anomalous situations alerting. This study focuses on human activity recognition based on smartphone embedded sensors. The proposed human activity recognition system recognizes activities including walking, running, sitting, going upstairs, and going downstairs. Embedded sensors (a tri-axial accelerometer and a gyroscope sensor) are employed for motion data collection. Both time-domain and frequency-domain features are extracted and analyzed. Our experiment results show that time-domain features are good enough to recognize basic human activities. The system is implemented in an Android smartphone platform. While the focus has been on human activity recognition systems based on a supervised learning approach, an incremental clustering algorithm is investigated. The proposed unsupervised (clustering) activity detection scheme works in an incremental manner, which contains two stages. In the first stage, streamed sensor data will be processed. A single-pass clustering algorithm is used to generate pre-clustered results for the next stage. In the second stage, pre-clustered results will be refined to form the final clusters, which means the clusters are built incrementally by adding one cluster at a time. Experiments on smartphone sensor data of five basic human activities show that the proposed scheme can get comparable results with traditional clustering algorithms but working in a streaming and incremental manner. In order to develop more accurate activity recognition systems independent of smartphone models, effects of sensor differences across various smartphone models are investigated. We present the impairments of different smartphone embedded sensor models on HAR applications. Outlier removal, interpolation, and filtering in pre-processing stage are proposed as mitigating techniques. Based on datasets collected from four distinct smartphones, the proposed mitigating techniques show positive effects on 10-fold cross validation, device-to-device validation, and leave-one-out validation. Improved performance for smartphone based human activity recognition is observed. With the efforts of developing human activity recognition systems based on supervised learning approach, investigating a clustering based incremental activity recognition system with its potential applications, and applying techniques for alleviating sensor difference effects, a robust human activity recognition system can be trained in either supervised or unsupervised way and can be adapted to multiple devices with being less dependent on different sensor specifications

Semantic-Aware Real-Time Correlation Tracking Framework for UAV Videos

Discriminative correlation filter (DCF) has contributed tremendously to address the problem of object tracking benefitting from its high computational efficiency. However, it has suffered from performance degradation in unmanned aerial vehicle (UAV) tracking. This article presents a novel semantic-aware real-time correlation tracking framework (SARCT) for UAV videos to enhance the performance of DCF trackers without incurring excessive computing cost. Specifically, SARCT first constructs an additional detection module to generate ROI proposals and to filter any response regarding the target irrelevant area. Then, a novel semantic segmentation module based on semantic template generation and semantic coefficient prediction is further introduced to capture semantic information, which can provide precise ROI mask, thereby effectively suppressing background interference in the ROI proposals. By sharing features and specific network layers for object detection and semantic segmentation, SARCT reduces parameter redundancy to attain sufficient speed for real-time applications. Systematic experiments are conducted on three typical aerial datasets in order to evaluate the performance of the proposed SARCT. The results demonstrate that SARCT is able to improve the accuracy of conventional DCF-based trackers significantly, outperforming state-of-the-art deep trackers

A real-world observation of antipsychotic effects on brain volumes and intrinsic brain activity in schizophrenia

Background: The confounding effects of antipsychotics that led to the inconsistencies of neuroimaging findings have long been the barriers to understanding the pathophysiology of schizophrenia (SZ). Although it is widely accepted that antipsychotics can alleviate psychotic symptoms during the early most acute phase, the longer-term effects of antipsychotics on the brain have been unclear. This study aims to look at the susceptibility of different imaging measures to longer-term medicated status through real-world observation. Methods: We compared gray matter volume (GMV) with amplitude of low-frequency fluctuations (ALFFs) in 89 medicated-schizophrenia (med-SZ), 81 unmedicated-schizophrenia (unmed-SZ), and 235 healthy controls (HC), and the differences were explored for relationships between imaging modalities and clinical variables. We also analyzed age-related effects on GMV and ALFF values in the two patient groups (med-SZ and unmed-SZ). Results: Med-SZ demonstrated less GMV in the prefrontal cortex, temporal lobe, cingulate gyri, and left insula than unmed-SZ and HC ( Conclusion: GMV loss appeared to be pronounced to longer-term antipsychotics, whereby imbalanced alterations in regional low-frequency fluctuations persisted unaffected by antipsychotic treatment. Our findings may help to understand the disease course of SZ and potentially identify a reliable neuroimaging feature for diagnosis

Feature Sensing and Robotic Grasping of Objects with Uncertain Information: A Review

As there come to be more applications of intelligent robots, their task object is becoming more varied. However, it is still a challenge for a robot to handle unfamiliar objects. We review the recent work on the feature sensing and robotic grasping of objects with uncertain information. In particular, we focus on how the robot perceives the features of an object, so as to reduce the uncertainty of objects, and how the robot completes object grasping through the learning-based approach when the traditional approach fails. The uncertain information is classified into geometric information and physical information. Based on the type of uncertain information, the object is further classified into three categories, which are geometric-uncertain objects, physical-uncertain objects, and unknown objects. Furthermore, the approaches to the feature sensing and robotic grasping of these objects are presented based on the varied characteristics of each type of object. Finally, we summarize the reviewed approaches for uncertain objects and provide some interesting issues to be more investigated in the future. It is found that the object’s features, such as material and compactness, are difficult to be sensed, and the object grasping approach based on learning networks plays a more important role when the unknown degree of the task object increases

Antipsychotic Effects on Cortical Morphology in Schizophrenia and Bipolar Disorders

Background: Previous studies of atypical antipsychotic effects on cortical structures in schizophrenia (SZ) and bipolar disorder (BD) have findings that vary between the short and long term. In particular, there has not been a study exploring the effects of atypical antipsychotics on age-related cortical structural changes in SZ and BD. This study aimed to determine whether mid- to long-term atypical antipsychotic treatment (mean duration = 20 months) is associated with cortical structural changes and whether age-related cortical structural changes are affected by atypical antipsychotics. Methods: Structural magnetic resonance imaging images were obtained from 445 participants consisting of 88 medicated patients (67 with SZ, 21 with BD), 84 unmedicated patients (50 with SZ, 34 with BD), and 273 healthy controls (HC). Surface-based analyses were employed to detect differences in thickness and area among the three groups. We examined the age-related effects of atypical antipsychotics after excluding the potential effects of illness duration. Results: Significant differences in cortical thickness were observed in the frontal, temporal, parietal, and insular areas and the isthmus of the cingulate gyrus. The medicated group showed greater cortical thinning in these regions than the unmediated group and HC; furthermore, there were age-related differences in the effects of atypical antipsychotics, and these effects did not relate to illness duration. Moreover, cortical thinning was significantly correlated with lower symptom scores and Wisconsin Card Sorting Test (WCST) deficits in patients. After false discovery rate correction, cortical thinning in the right middle temporal gyrus in patients was significantly positively correlated with lower HAMD scores. The unmedicated group showed only greater frontotemporal thickness than the HC group. Conclusion: Mid- to long-term atypical antipsychotic use may adversely affect cortical thickness over the course of treatment and ageing and may also result in worsening cognitive function